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Background of the Invention 

1. Technical Field 

The present invention relates to a method for partitioning the columns of a matrix. 

2. Related Art 

Critical dimensions in microelectronic designs have been rapidly scaling to smaller and 
smaller values leading to increased parametric variability in digital integrated circuit 
performance. The resulting increase in the number of significant and independent sources of 
variation leads to exponential complexity for traditional static timing methodologies. One 
solution to this problem is path-based statistical timing analysis, in which the probability 
distribution of the performance of a chip is computed in a single analysis, simultaneously taking 
into account all sources of variation. Such probabilistic methods are often dependent on 
restricting the sources of variation to a small number, and several algorithms proposed in the 
literature have exponential complexity in the dimensionality of the process space. Thus, there is 
a need for a method that facilitates an efficient and simple use of statistical timing analysis in a 
way that takes into account the effect of all pertinent sources of variation. 
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Summary of the Invention 

The present invention provides a method of partitioning the columns of a matrix A, said 
method comprising: 

providing the matrix A in a memory device of a computer system, said matrix A having n 
columns and m rows, n being an integer of at least 3, m being an integer of at least 1 ; and 

executing an algorithm by a processor of the computer system, said executing including 
partitioning the n columns of the matrix A into a closed group of/? clusters, p being a positive 
integer of at least 2 and less than n, said partitioning comprising an affinity-based merging of 
clusters of the matrix A, each said cluster consisting of one or more columns of said matrix A. 

The present invention provides a method of partitioning the columns of a matrix A, said 
method comprising executing an algorithm by a processor of a computer system, said executing 
including performing the steps of: s 

generating a list of clusters having n clusters such that each of the n clusters consist of a 
unique column of the matrix A, said matrix A being stored in a memory device of the computer 
system, said matrix A having n columns and m rows, n being an integer of at least 3, m being an 
integer of at least 1, each said cluster consisting of one or more columns of said matrix A; 

determining if a termination condition is satisfied and if said determining so determines 
that said termination condition is satisfied then terminating said executing else performing the 
following steps: 

selecting a next pair of clusters from the list of clusters, said next pair of clusters 
consisting of a first cluster and a second cluster, said next pair of clusters having an 
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affinity that is not less than an affinity between any pair of clusters not yet selected from 
the list of clusters; 

merging the first and second clusters to form a new cluster; 

inserting the new cluster into the list of clusters while removing the first and 
second clusters from the list of clusters; and 

re-executing said determining step. 

The present invention provides a computer program product, comprising a computer 
usable medium having a computer readable program embodied therein, said computer readable 
program comprising an algorithm for partitioning the columns of a matrix A, said algorithm 
adapted to perform the steps of: 

providing the matrix A in a memory device of the computer system, said matrix A having 
n columns and m rows, n being an integer of at least 3, m being an integer of at least 1; and 

partitioning the n columns of the matrix A into a closed group of p clusters, p being a 
positive integer of at least 2 and less than w, said partitioning comprising an affinity-based 
merging of clusters of the matrix A, each said cluster consisting of one or more columns of said 
matrix A. 

The present invention provides a computer program product, comprising a computer 
usable medium having a computer readable program embodied therein, said computer readable 
program comprising an algorithm for partitioning the columns of a matrix A, said algorithm 
adapted to perform the steps of: 
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generating a list of clusters having n clusters such that each of the n clusters is a unique 
column of the matrix A, said matrix A being stored in a memory device of the computer system, 
said matrix A having n columns and m rows, n being an integer of at least 3, m being an integer 
of at least 1, each said cluster consisting of one or more columns of said matrix A\ 

determining if a termination condition is satisfied and if said determining so determines 
that said termination condition is satisfied then terminating said algorithm else executing the 
following steps: 

selecting a next pair of clusters from the list of clusters, said next pair of clusters 
consisting of a first cluster and a second cluster, said next pair of clusters having an 
affinity that is not less than an affinity between any pair of clusters not yet selected from 
the list of clusters; 

merging the first and second clusters to form a new cluster; 

inserting the new cluster into the list of clusters while removing the first and 
second clusters from the list of clusters; and 

re-executing said determining step. 

The present invention advantageously facilitates an efficient and simple use of statistical 
timing analysis of electrical circuits in a way that takes into account the effect of all pertinent 
sources of variation. 



Brief Description of the Drawings 

FIG. 1 is a flow chart of a path-based statistical timing method including a dimensionality 
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reduction, in accordance with embodiments of the present invention. 

FIG. 2 is a flow chart describing the dimensionality reduction of FIG. 1 including a 
matrix partitioning, in accordance with embodiments of the present invention. 

FIG. 3 is a plot of affinity versus alignment for different values of norm-ratio, in 
accordance with embodiments of the present invention. 

FIG. 4 is a flow chart describing the matrix partitioning of FIG. 2, in accordance with 
embodiments of the present invention. 

FIG. 5 illustrates a computer system used for affinity-based clustering of vectors for 
partitioning the columns of a matrix, in accordance with embodiments of the present invention 

Detailed Description of the Invention 

The present invention discloses a method for partitioning the columns of a matrix on the 
-basis of a novel affinity measure. One application of the inventive method is reducing the 
number of independent variables utilized in a linear model, through a dimensionality-reduction 
scheme that uses a singular value decomposition (SVD) in conjunction with partitioning of the 
independent variables. Another application of the inventive method is that of a statistical timer 
which could then efficiently analyze the reduced-dimension system. 

FIG. 1 is a flow chart of a path-based statistical timing method in application to 
semiconductor chip timing, in accordance with embodiments of the present invention. A path is 
defined as a sequence of circuit elements through which a signal propagates. A complete path 
may include: the launching clock path, the data path, and the capturing clock path, so that 
correlations and commonalities between data and corresponding clock paths are fully captured. 
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A path slack is defined as the difference in time between a required arrival time (the latest 
or earliest time a signal must be stable in order or for the circuit to operate properly) of a signal 
at an end point P in the path and a calculated or actual arrival time (the latest or earliest time a 
signal actually becomes stable) of the signal at the point P. For sequential circuits, data arriving 
at a latch typically must be stable before the clock transition, and thus the path slack may be 
viewed as the algebraic difference between a clock path delay and a data path delay. The timing 
analysis method of FIG. 1 verifies the acceptability of the timing of the designed chip by 
confirming, for example, that the magnitude of the path delay is less than the clock cycle time so 
that the chip could be reliably operated. The timing analysis method calculates path slacks for 
each of m paths, wherein m is a positive integer. The m paths need not represent all timing paths 
in the chip, but may represent the m nominally most critical paths or a collection of the 
nominally most critical path or paths at each end point. As many paths are collected as are 
deemed to have a significant chance of being critical at some point in the process space. 

The first input is a netlist 12, which describes the structure and topology of the circuit to 
be analyzed. The timing analysis method uses timing assertions 14 and timing rules 16. 
Examples of timing assertions 14 include, inter alia, arrival times at the inputs, required arrival 
times at the outputs, external loads driven by the outputs, and clock edge and phase information. 
Examples of timing rules 16 include, inter alia, delay models for the delay and slew (rise/fall 
time) of every input-to-output transition of every component of the electrical circuit. These 
delay models may be in the form of equations with pre-characterized coefficients, or table 
models or means for computing the delay models on the fly by means of simulation. 
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The method initially uses a well-known Static Timing Analysis 10 to calculate nominal 
path slacks for each of m paths, wherein m is a positive integer. The m nominal path slacks are 
characterized by a vector d G m (i.e., the /w-dimensional space of real numbers) and are 
calculated by using nominal values of the independent variables modeled. 
5 After the Static Timing Analysis 10 is performed, the method executes an m Paths 

Selection Correlation Computation 20, utilizing a process variation vector x 22 (described infra). 
The Computation 20 may include a static timing analysis with forward propagation of nominal 
arrival times and backward propagation of nominal required arrival times through a timing graph 
representing the timing properties of the electrical circuit. It may also include a path-tracing 

10 procedure to list the nominally most critical paths, or the most critical path or paths leading up to 
each end point. It may also include a slack recording procedure to record the nominal slack of 
each such path. It may also include a sensitivity procedure to determine the sensitivity of each 
such path slack to each source of variation. The sensitivity procedure may traverse the path and 
collect sensitivities from the delay models, or may use simulation on the fly, or may employ 

15 finite differencing to determine the sensitivities. 

The Static Timing Analysis 10 produces a nominal result of the timing of the circuit, 
whereas the present invention determines the full probability distribution of the timing of the 
circuit while taking into account sources of variation. With the Static Timing Analysis 10, the 
nominal calculated arrival time of the signal at the point P does not account for the dependence 

.20 of path slack on a set of independent stochastic variables whose deviation from nominal values is 
described by a vector x G 9? " (i.e., the vector X 22 of FIG. 1) of order n having elements x\ 
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(i=l, 2,..., «). Each independent variable x t is a random variable characterized by a probability 
density function (PDF), which may represent a normal probability distribution or any other form 
of probability distribution. 

The independent variables x\ may be, inter alia, process variations which may fit into 
some or all of the following categories: process variations (e.g., control parameters operative 
during processing such as focus of a lens during photolithography or dose of ions during 
implantation); manufacturing variations (e.g., manufacturing dimensional tolerances), operating 
conditions variations (e.g., operating temperature of the chip, power supply voltage); fatigue- 
related variations (e.g., power-on hours or product lifetime); and modeling errors (e.g., neglect or 
approximation of a term in a modeling equation); material property variations (e.g., electrical 
conductivities, capacitances, doping concentrations, etc.). 

The path slack variations d of the paths are each assumed to be a linear function of the 
sources of variation x x . Although, the assumption of linearity may represent an approximation 
for one or more of the variables x\, the linearity approximation for any variable x x can be made 
increasingly accurate by decreasing the numerical range of x\. The path slacks are modeled as 

d+d = d+Ax (1) 

wherein d e${ m represents the variation of the path slacks from their nominal values and 

A e 9? m * n is a coefficient matrix which facilitates expression of the path slack variations d as 

a linear combination of the process variations X. - The matrix A is identified in FIG. 1 as the 
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coefficient matrix A 24. Scaling may be applied in a pre-processing step to obtain circular 
symmetry; i.e., the x variables x { can be treated, for convenience and without loss of generality, 
as unit- variance zero-mean independent random variables after the scaling. 

The dimensionality reduction step 30 generates a new coefficient matrix B and an 
associated new set ofp statistically independent variables in a vector z of order/?, wherein p<n. 
The new coefficient matrix B is identified in FIG. 1 as the new coefficient matrix B 34, wherein 
B is an m x p matrix. The new process variable vector z, which is associated with the new 
coefficient matrix B, is identified in FIG. 1 as the vector z of reduced variables 32. 
Implementation of the dimensionality reduction step 30 will be discussed infra in conjunction 
with FIGS. 2-4. 

Following the dimensionality reduction step 30, a statistical timing analysis 36 may be 
performed as described, for example, by Jess et al. (see Reference [1]). A yield curve 38 may be 
determined as an output of the timing analysis 36. Various diagnostics may also be produced as 
an output of the timing analysis 36. The efficiency of all three methods would benefit from 
performing the analysis in a lower-dimensional space. 

FIG. 2 is a flow chart describing the dimensionality reduction 30 of FIG. 1, in accordance 
with embodiments of the present invention. The process of FIG. 2 starts with the m x n matrix A 
24 and vector x 22 of order n, and determines the m xp matrix B 34 and the vector z 32 of order 
p, wherein 2<p<n. As pin is reduced, further dimensionality reduction is achieved. However, 
decreasing p relative to n increases the numerical errors of the procedure, so that a lower bound 
for/? is controlled by a degree of accuracy desired, as will be explained infra. 
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The process of FIG. 2 starts with the linear model of the deviation of the path slacks from 
their, nominal values 

d = Ax (2) 

The number of paths m may be large (such as, inter alia, 10,000 or higher), while the number of 
statistically independent process variables n may be smaller (such as, inter alia, 30 to 50). The 
method of FIG. 2 seeks a reduction in the number of statistically independent process variables 
by looking for a new set of statistically independent process variables z e 9? p , where 2<p<n 
(nz 3), such that 



d=Bz ' 0) 

where B is the nev/mxp coefficient matrix, and d e m is the new path-slack variation 
vector, which is the lower-dimensionality approximation to the original vector d. The number 
ip) of new process variables may be small (such as, inter alia, 2 to 5). Moreover, each new 
process variable will be a linear combination of the old process variables. For some choices of B, 
however, z may not be statistically independent, especially in the case of non-Gaussian process 
variations. However, Li et al. (see Reference [2]) have used a technique based on Singular 
Value Decomposition (SVD) to find B and z such that: the new process variables z are also 
statistically independent, even for non-Gaussian sources of variation; and the Euclidean norm of 
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the error W - J II is as small as possible. Li et al. have shown that statistical independence is 

preserved by partitioning the columns of the original coefficient matrix A into/> clusters and 
constructing the new coefficient matrix B and the new process variables z using the (largest) 
singular values and corresponding (left and right) singular vectors of each of the/? clusters of A 
in a technique referred to as SMSVD (Sub-Matrix SVD). Accordingly, step 40 of FIG. 2 
partitions the columns of the coefficient matrix A into/? clusters denoted as A {i) , A (2) , .... and 
Aq,). The novel manner in which the coefficient matrix A is partitioned into the/> clusters in 
accordance with the present invention is disclosed herein in accordance with FIGS. 3-4 and a. 
description thereof. 

Assuming that the coefficient matrix A has been partitioned into the p clusters (as will be 
described infra), let A^ denote the cluster corresponding to the *-fh cluster and let x w denote the 
corresponding sub-vector of process variables. Using SVD (see Reference [3]), step 42 of FIG. 2 
approximates each cluster A^ by its principal component as 



T (4) 
A (k) a(7 (k),l u (k),l v (k),l 



where c (k)>1 is the largest singular value, u (k) ,i is the corresponding left singular vector, and v^,, 
is the corresponding right singular vector of the k-th cluster A^. Equation (4) is the only source 
of approximation in the dimensionality reduction procedure relating to the SMSVD technique of 
Reference [2]. 

END920030067US1 H 



The Jfc-th column of the new mxp coefficient matrix B is 



b k = a (k),\ u (k),l 



■ (5) 



which is the left singular vector of the cluster of .the *-th cluster scaled by its largest singular 
5 value. The k-th new process variable z k is: 



Accordingly, step 44 of FIG. 2 determines b k and z k via Equations (5) and (6), respectively. 
Since z k depends only on original process variables in the k-th cluster and the different clusters 

10 are disjoint by definition, statistical independence is preserved in z, as shown in Reference [2]. 
Since each of these (left or right) singular vectors has a unit norm, the linear transformation (6) 
ensures that the z variables also have zero mean and unit variance, given that the original x 
variables had zero mean and unit variance, which is an added convenience. 

The affinity-based clustering technique of the present invention will next be described. 

1 5 As remarked earlier, the only approximation in the dimensionality reduction procedure is in 
Equation (4). From SVD theory (See Reference [3]), it can be shown that the cluster 
approximation error E in the SVD approximation can be measured by 





(7) 
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which means that for each cluster, as long as the second largest singular value 0^,2 of its cluster 
A w is much smaller than its largest singular value ctoo,i, there will be little or no error due to the 
approximation of Equation (4). For any given cluster of columns of the matrix A, one can 
compute the approximation error by Equation (7) above. A brute-force method of trying all 
5 possible clusters and picking the best having the smaller error can be used, but is impractical for 
large n, since Reference [4] shows that the total number of ways to partition n objects into/? 
clusters is given by the Stirling Number of the second kind which is exponential in n. 

However, the present invention discloses an algorithm to find a good clustering of 
columns of A, that will result in a small error computed by Equation (7) as will be discussed 
1 0 next. Specifically, the novel clustering technique of the present invention exploits a novel • 

affinity measure between two vectors, wherein the affinity is a function of the ratio of the norms 
of the two vectors and of a relative alignment between the two vectors. This clustering scheme is 
based on the pair-wise affinity between the columns of A. To this end, let w andy be any two 

arbitrary non-zero vectors. Assuming that llyll < IMI, the norm-ratio a between y and w is defined 



15 as 



a H 



and the alignment /? between j> and w is defined as 



(8) 
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so 



that the alignment /?may be interpreted as the cosine of the angle between vectors y and w. 
The norm P is defined as the root mean square of the entries ofy; i.e., if y is a vector of order n 
having ordered components y\ , yi, y?>, . . ., y n , then 

p = t(yi) 2 + (ytf + fo) 2 + • • • + (y^ n 



It is assumed herein that 0<«<1 and it follows from the Cauchy-Schwartz inequality that 

0<y3<l. Alsoi if p=0 then the two vectors are orthogonal (i.e., the angle between y and w is 

either 90 or 270 degrees). If 0=1, theny and w are perfectly aligned (i.e., the angle between y 

and w is either 0 or 180 degrees). 

Next, effect of clustering y and w together is considered by defining a matrix 5= [ wy ] 
with 2 columns w andy, and computing the two (largest) singular values of S. Note that the 
further the gap is between these two singular values, the better is the quality of clustering y in the 
same partition as w. Note that a "partition," a "cluster," and a "sub-matrix" each have the same 
meaning herein. Thus a cluster of the matrix A is defined herein, including in the claims, as a 
matrix that includes one or more columns of the matrix A such that no column of the matrix A 
appears more than once in the cluster. A group of two or more clusters of the matrix A is defined 
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herein and in the claims to be a "closed group" of the matrix A if no two clusters in the group 
include a same column of the matrix A and if the group of clusters collectively include all 
columns of the matrix A. By the preceding definition, any column or group of columns of the 
matrix A is a cluster of the matrix A. Any cluster not in the closed group is said to be outside of 
the closed group. The present invention, however, discloses infra how to form particular clusters 
of the matrix A based on using an "affinity" of the columns of the matrix A, wherein said 
particular clusters of the matrix A are utilized in a manner that reduces or minimizes the error 
expressed in Equation (7). 

Forming S T S: 

1 ±ap~ 
±afi a 2 

Thus, the eigen-values of S T S are hv IF times the roots X, and k 2 of the characteristic polynomial 
derived as follows: 

(M)(l-fl 2 )-«V 2 
X 2 -(l + a 2 )X + a 2 (l-/? 2 ) 



S T S = 



T T 

w w w y 

T T 

y w y v 



= \\w\\ 



det 



_+afi A-a 2 _ 
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so that 

J\ + a 2 )±J (\ + a 2 ) 2 -4a 2 (\- /3 2 ) 



But the singular values 0,(5) and o 2 (S) of S are II w II times the square-root of Ai and X 2 , 
5 respectively, which are: 

The affinity between the two vectors^ and w is now defined to be 

10 

affinity = 1 - ^{f| 



l + a 2 -V(l + « 2 ) 2 


-4a 2 (1 


-/? 2 ) 


l + a 2 +4(\ + a 2 ) 2 


-4a 2 ' (1 





(10) 



Using Equation (10), FIG. 3 shows the plot of affinity versus the alignment ft for several 
values of the norm-ratio a. From Equation (10), the affinity is a real number between 0 and 1 . 
1 5 For each of the curves of FIG. 3, the affinity at/?=l (i.e., perfect alignment between y and w) is 
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1 while the affinity at 0=0 (i.e.,y and w are orthogonal to each other) is 1-<X The affinity is a 
monotonically increasing function of the alignment /? for a fixed norm-ratio a. The closer the 
affinity is to 1, the better is the quality of the cluster obtained by putting^ in the same cluster as 
w. An affinity close to 0 means y and w should be in different clusters. This explains the 
clustering algorithm depicted in FIG. 4 for clustering the n columns of a given mxn matrix A 
into p parts, assuming 2 < p<n (n*3). 

In FIG. 4, the input to the algorithm comprises the coefficient matrix A (denoted as 
reference numeral 24) and specification of the reduced number/) of independent process 
variables (denoted as reference numeral 26). Note that the matrix A is provided in a memory 
device of a computer system such as the computer system 90 of FIG. 5 discussed infra. A means 
for providing the matrix A in the memory device may include, inter alia, reading the matrix A 
into the memory device. 

The algorithm depicted in FIG. 4 comprises steps 51-60. 

Step 51 computes the norm-ratio a, alignment /?, and the affinity, using Equations (8), 

(9), and (10) for each pair of columns in the coefficient matrix A. 

Step 52 sorts the column pairs in decreasing order of affinity. 

Step 53 creates a list of clusters comprising n initial clusters such that each of the n initial 
clusters is a unique column of the coefficient matrix A. Generally, a cluster includes one or more 
columns of the coefficient matrix A as will be seen infra through the cluster merging step 59. 
Each cluster has a "leader" which is the column having the largest norm of all of the columns in 
the cluster. Thus initially, every column of the coefficient matrix A is both a cluster and a leader 
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of the cluster, and the initial number of clusters is equal to n. Note that the affinity between two 
clusters is defined as the affinity between the leaders of the two clusters. 
Step 54 initializes a cluster count index q to n (i.e., q = n initially). 
Step 55 determines whether to terminate the clustering algorithm based on satisfaction of 
a termination condition. In one embodiment, the termination condition is that the number of 
clusters formed thus far (q) is equal to the desired number of reduced independent process 
variables (p). Alternative termination conditions will be discussed infra. If YES (i.e., q =p) 
then the process STOPs in step 56. If NO (i.e., q >p) then step 57 is next executed. 

Step 57 selects a next pair of clusters having an affinity therebetween (i.e., between the 
two clusters of the next pair of clusters) not less than an affinity between clusters of any existing 
pair of clusters not yet selected from the list of clusters. During the first execution of step 57,.the 
existing clusters in the list of clusters each consist of a single column as explained supra in 
conjunction with step 53, so that the next pair of clusters is selected from the sorted list of 
column pairs. It should be recalled from step 52 that the column pairs are positioned in the 
sorted list of column pairs in order of decreasing value of affinity, so the first column pair picked 
has the highest affinity; the second column pair to be picked has the second highest affinity, etc. 

The pair of clusters selected in step 57 consists of two clusters, namely a first cluster and 
a second cluster. Step 58 determines, for the cluster pair picked in step 57, whether to merge the 
first cluster with the second cluster to form a new cluster. During the first execution of step 58, 
the first and second clusters of the cluster pair selected in step 57 respectively consist of a first 
column and a second column as explained supra in conjunction with step 53, and step 58 
determines whether the first column and the second column from the column pair are each in a 
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separate cluster (i.e., whether the first and second clusters are different clusters), and if so 
whether the first and second columns are leaders of the first and second clusters, respectively. If 
the first column and second columns are in the same cluster already or if either the first or second 
column is not a leader currently of its cluster, then the procedure returns to step 57 to select the 
next pair of clusters. Otherwise, step 59 is next executed. 

Step 59 merges the first and second clusters to form a new cluster. Let N\ and N 2 
represent the norm of the leader of the first and second clusters, respectively. The leader of the 
new cluster is the leader (L{) of the first cluster if M > N 2 or the leader of the new cluster is the 
leader (L 2 ) of the second cluster if N 2 > N\. If M = N 2 then either L x or L 2 could be the leader of 
the new cluster, using an arbitrary choice of L\ or L 2 , or a random selection of L\ or L 2 . The new 
cluster thus formed is added to the list of clusters and the first and second clusters are removed-., 
from the list of clusters. 

In an embodiment, the merging of the first and second clusters to form the new cluster in 
step 59 removes the first and second clusters as individual clusters for subsequent consideration 
in the partitioning of the columns of the matrix A. This also removes any non-leader column pair 
in the list of column pairs of step 52, wherein said any non-leader column pair includes any 
column of the merged first and second clusters that is not the leader of the merged cluster. Thus 
in this embodiment, step 58 is unnecessary since the conditions for not merging the clusters of 
the selected cluster pair appear cannot be satisfied; i.e., the first and second columns will always 
be a leader in the case of a cluster consisting of more than one column, and the first and second 
clusters of the cluster pair must be in different clusters due to said removal of column pairs in the 
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list of cluster pairs. Hence in this embodiment, each pair of clusters selected in step 57 will be 
merged to form a new cluster in step 59. 

The procedure next executes step 60, which decrements the cluster count index q by 1 , 
inasmuch as two clusters have been merged into a single cluster (i.e., the new cluster in step 59). 

5 The procedure next returns to step 55. 

Note that the particular clusters formed by the process of FIG. 4 may consist of merged 
clusters and unmerged clusters. The merged clusters are formed in step 59. The unmerged 
clusters (if any) consist of any clusters of the initially formed n clusters in step 53 that have not 
been merged in step 59. As an example, consider an example of n=5 and p=3, wherein the group 

10 of clusters formed by the affinity-based process of FIG. 4 results in the formation of three 

clusters consisting of a first cluster of columns 2 and 5 (a merged cluster), a second cluster of 
columns 3 and 4 (a merged cluster), and a third cluster of column 1 (an unmerged cluster). Of 
course, many other clusters of the matrix A also exist but are not selected in the affinity-based 
procedure (e.g., a cluster consisting of columns 1 and 3, a cluster consisting of columns 2-5, a 

1 5 cluster consisting of column 2, etc.). 

Consider the following numerical example to illustrate the clustering technique of the 
present invention, using the following 6x4 matrix A such that m=6 and «=4: 



END920030067US1 



20 



A = 
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-7 
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-6 
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7 
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-7 
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-6 
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7 


8 


6 


9 


-7 


8 


-6 



(11) 



Note that A is a 6 x 4 matrix with h=4 columns and /n=6 rows. It is desired to reduce the number 
of process variables to 2 so that the procedure will attempt to reduce the initial n=4 clusters to 
p=2 clusters. First, a list is constructed of all 6 possible pairs of columns sorted in decreasing 
order of their pair- wise affinity (see step 52 of FIG. 4) as shown in Table 1. 



Table 1. 



Column Pair 


P 


a 


Affinity 


(1,3) 


1 


8/9 


1 


(2,4) 


1 


6/7 


1 


(1,4) 


0 


6/9 


1/3 


(3,4) 


0 


6/8 


1/4 


(1,2) 


0 


7/9 


2/9 


(2,3) 


0 


7/8 


1/8 



Table 1 shows that column pairs (1,3) and (2,4) are each perfectly aligned (i.e., p=l). This 
results in an affinity of 1 for these two pairs irrespective of their norm-ratios (Ots). Hence, these 
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two pairs come out at the top of the sorted list of column pairs. The remaining pairs are 

orthogonal (i.e., p=0) resulting in their affinity being 1-a, and hence appear at the bottom of the 

sorted list. Initially, there are 4 clusters (i.e., q=4 initially in accordance with step 54 of FIG. 4), 
and each column is in its own cluster and is the leader of its cluster (see step 53 of FIG. 4). 

Since initially q *p (i.e., 4 * 2), the first pair (1,3) in the sorted list is selected (see steps 
55 and 57 of FIG. 4). Both columns 1 and 3 are currently in different clusters and leaders of their 
respective clusters, which leads to the "YES" result of decision step 58 of FIG. 4. Therefore step 
59 of FIG. 4 merges columns 1 and 3 into a single new cluster {1,3} and marks column 1 as the - 
leader of the new cluster, since column 1 has a larger norm than the norm of column 3. 

Next, step 60 of FIG. 4 decrements the cluster counter q to q=3. The next pair in Table 1, 
which is (2,4), is selected (see step 57 of FIG. 4) and both columns 2 and 4 are currently in 
different clusters and leaders of their respective clusters. Therefore columns 2 and 4 are merged 
into a single new cluster {2,4} and column 2 is marked as its leader (since column 2 has the 
larger norm), in accordance with steps 57-58 of FIG. 4. The cluster counter q is decremented to 
9=2 (see step 60 of FIG. 4) which matches the number p=2 9 thereby satisfying the STOP 
condition (i.e., q =p) of step 55 of FIG. 4, resulting in a final cluster set of {1,3} and {2,4}. This 
final clustering results in the following clusters of the original A: 
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^(1) - 



9 8 

9 8 

9 8 

9 8 

9 8 

9 8 



^(2) - 



7 6 

-7 -6 

7 6 

-7 -6 

7 6 

-7 -6 



Since each cluster has only two columns, it follows that: 



^(1)^(1) 



9 9 9 9 9 9 
8 8 8 8 8 8 



9 


8 


9 


8 


9 


8 


9 


8 


9 


8 


9 


8 



(12) 



486 432 
432 384 



A (2) A {2) ~ 



1 -11-11 -1 

6-66-66-6 



1 
-1 

1 
-1 

1 
-1 



6 
6 
6 
6 
6 
6 



(13) 



294 252' 
252 216 



The eigen-values of the above 2x2 matrices are 870 and 0 for the matrix of Equation (12) and 
510 and 0 for the matrix of Equation (13). Therefore, the singular values of the two clusters 
are: 
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<T (1)fl =A/ r 870 = 29.495762, ct (1)>2 =0 



a (2)>1 =V510 = 22.583180, cr (2)i2 =0 



10 



15 



Thus, according to Equation (7), the approximation error E for this particular choice of clustering 
is 0, which means that this is the best cluster partitioning for p = 2 for this example. 

The corresponding left singular vector and the right singular vector v^i of the &-th 
cluster ^4(k) for the largest singular values are calculated as follows. The left singular vector W(k),i 
is an m-component vector computed as being proportional to the leader of A^y The right 
singular vector v^i is a 2-component vector whose first element is proportional to the average 
value of the leader of A(yy Both t/(k),i and v^i are renormalized to a unit norm. Thus, for this 
example: 



u 



(l),l 









"0.4082" 








0.4082 


1 






0.4082 








0.4082 








0.4082 








0.4082 



"9" 




"0.7474" 


L 8 J 




_ 0.6644 _ 
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u 



(2),1 



41 







0.4082" 






-0.4082 






0.4082 






-0.4082 






0.4082 






-0.4082 



(2),1 



7 2 +6 : 



"7" 




"0.7593" 


6 




0.6508 



Using Equation (5), the two columns b\ and Z> 2 of the new coefficient matrix B are: 



*1 = °"(l),l"(l),l =^145 







"12.0416" 






12.0416 






12.0416 






12.0416 






12.0416 






12.0416 



and 



10 



b 2 =o- (2)1 w (2) , = V85 







9.2195" 






-9.2195 






9.2195 






-9.2195 






9.2195 






-9.2195 
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Using the computed values of b\ and bi, the new coefficient matrix B is: 



B = 



12.0416 


9.2195 


12.0416 


-9.2195 


12.0416 


9.2195 


12.0416 


-9.2195 


12.0416 


9.2195 


12.0416 


-9.2195 



Using Equation (6), the new process variables Z\ and Z2 are: 



z i - v ( J i),i*(i) = 0.7474 x x + 0.6644 x y 



z 2 = v (2) i \ x (2) = 0.7593 * 2 +0.6508*4 



In an embodiment, the desired number of clusters p is supplied as an input to the 
algorithm of FIG. 4. In this embodiment the termination condition in step 55 of FIG. 4 may be q 
=p wherein q is the cluster count index. 

In a first alternative embodiment, the above affinity-based clustering algorithm stops 

r 

when the affinity in the current pair of columns from the sorted list falls below an affinity 
threshold. The affinity threshold may be supplied as an input to the algorithm. If the affinity of 
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the next pair of clusters selected in the selecting step 57 of FIG. 4 is less than the affinity 
threshold, then a flag may be set indicating that the termination condition has been satisfied, 
followed by re-executing step 55 while not executing steps 57-60. This first alternative 
embodiment will prevent clustering of columns with poor affinity. The number of clusters 
produced by this first alternative embodiment may be more than the desired number/? specified. 
Alternatively p need not be specified as input for this first alternative embodiment, resulting in a 
smallest computed value of p such that the affinity in each cluster of the final set of clusters 
exceeds the affinity threshold. 

In a second alternative embodiment, an error tolerance e could be specified and the 
algorithm could be modified to generate the smallest number of clusters p for which the cluster 
approximation error E according to Equation (7) is less than the error tolerance e. The error 
tolerance e may be supplied as an input to the algorithm. If the selecting step 57 of FIG. 4 results 
in list of clusters having a cluster approximation error E such that E z e, then a flag may be set 
indicating that the termination condition has been satisfied, followed by re-executing step 55 
while not executing steps 57-60" 

In a third alternative embodiment employing a hybrid procedure, assume that it is desired 
to partition a matrix H having TV columns. In this hybrid procedure, n columns of the N columns 
are partitioned into p clusters by the affinity-based clustering of the present invention, and they 
columns of the N columns are partitioned into t clusters by another method (e.g., standard SVD), 
wherein n+j = N. Values of p and / could be independent inputs. Alternatively,/? + t could be 
an input, wherein p and / could be determined via any desired criterion such as, inter alia, a 
criterion of/?// = n/j, i.e., the partition sizes are proportional to the number of columns of the 
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partitions in the original matrix, to the nearest integer. As an example of this hybrid procedure, 
the n columns could be associated with an independent set of process variables x\ (/=1, 2, . . ., 
/i)having non-gaussian sources of variation, and the j columns could be associated withy 
additional process variable Wk (£=1 , 2, . . .J) having gaussian sources of variation. The combined 
reduced set ofp + / process variables resulting from this hybrid procedure would be statistically 
independent. This hybrid procedure could be expanded such that n +j < N so that the remaining 
N- n -j columns of the AT columns are independently partitioned into one or more additional 
partitions of clusters. Each additional partition of clusters may be generated by any desired 
method that preserves the statistical independence of the final reduced set of process variables. 

In summary, the affinity-based clustering of the present invention comprises partitioning 
the n columns of the matrix A into a closed group ofp clusters, p being a positive integer of at 
least 2 and less than n 9 said partitioning comprising an affinity-based merging of clusters of the 
matrix A. The following discussion clarifies the meaning of "affinity-based merging" of clusters 
of the matrix A. Said affinity-based merging of clusters of the matrix A considers all candidate 
clusters of the matrix A which may be merged pairwise, and determines or provides the affinity 
between the clusters of each such pair of candidate clusters ("pairwise" affinities). Then the 
affinity-based merging selects a pair of such candidate clusters to be merged based on comparing 
the pairwise affinities so determined or provided. In an embodiment described supra, the 
selected pair of candidate clusters was selected because it had a higher affinity than any other 
pair of candidate clusters. 

Although the inventive affinity-based clustering described herein may be advantageously 
applied to path-based statistical timing analysis relating to semiconductor chip timing, the 
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affinity-based clustering of the present invention may be generally used to reduce the number of 
degrees of freedom (i.e., dimensionality) used in any linear model. For various modeling, 
optimization, and analysis purposes, it may be beneficial to produce models of reduced 
dimensionality to capture the system behavior as a function of a smaller number of sources of 
variation. Thus, the inventive method may be used in many other domains such as, inter alia, 
mechanical or thermal design. As an example, the performance (such as vibration, gas mileage, 
stability or braking effectiveness, etc.) of a vehicle or airplane or helicopter can be modeled as a 
function of a number of sources of variation such as machining tolerances, material properties, 
temperature, etc. As another example, a stochastic model of the power dissipation of sub-circuits 
of an integrated circuit can be constructed as a function of temperature, device characteristics, 
input signals, chip activity, etc, and a reduced-dimensionality model can be constructed by the 
inventive method and applied in simulation, analysis, optimization or macromodeling of the 
power dissipation. 

FIG. 5 illustrates a computer system 90 used for affinity-based clustering of vectors for 
partitioning the columns of a matrix, in accordance with embodiments of the present invention. 
The computer system 90 comprises a processor 91, an input device 92 coupled to the processor 
91, an output device 93 coupled to the processor 91, and memory devices 94 and 95 each 
coupled to the processor 91. The input device 92 may be, inter alia, a keyboard, a mouse, etc. 
The output device 93 may be, inter alia, a printer, a plotter, a computer screen, a magnetic tape, a 
removable hard disk, a floppy disk, etc. The memory devices 94 arid 95 may be, inter alia, a 
hard disk, a floppy disk, a magnetic tape, an optical storage such as a compact disc (CD) or a 
digital video disc (DVD), a dynamic random access memory (DRAM), a read-only memory 
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(ROM), etc. The memory device 95 includes a computer code 97. The computer code 97 
includes an algorithm for affinity-based clustering of vectors for partitioning the columns of a 
matrix. The processor 91 executes the computer code 97. The memory device 94 includes input 
data 96. The input data 96 includes input required by the computer code 97. The output device 
93 displays output from the computer code 97. Either or both memory devices 94 and 95 (or one 
or more additional memory devices not shown in FIG. 5) may be used as a computer usable 
medium (or a computer readable medium or a program storage device) having a computer 
readable program code embodied therein and/or having other data stored therein, wherein the 
computer readable program code comprises the computer code 97. Generally, a computer 
program product (or, alternatively, an article of manufacture) of the computer system 90 may 
comprise said computer usable medium (or said program storage device). 

While FIG. 5 shows the computer system 90 as a particular configuration of hardware 
and software, any configuration of hardware and software, as would be known to a person of 
ordinary skill in the art, may be utilized for the purposes stated supra in conjunction with the 
particular computer system 90 of FIG. 5. For example, the memory devices 94 and 95 may be 
portions of a single memory device rather than separate memory devices. 

While embodiments of the present invention have been described herein for purposes of 
illustration, many modifications and changes will become apparent to those skilled in the art. 
Accordingly, the appended claims are intended to encompass all such modifications and changes 
as fall within the true spirit and scope of this invention. 
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